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Re: New U.S. Application 

of Thomas FECHNER and Stefan HEINRICH 
Entitled "PROCESS FOR RECOGNITION OF TRACK MARKERS 

USING IMAGE DATA" 
OurRef.: 3926.017 

Dear Sir: 

Attached hereto is the application identified above including the German language 
specification, claims, abstract; English language translation; and Preliminary Amendment. 

The Government filing fee is calculated as follows: 

Total claims 24_ - 20 = _4_ x $18 = $72.00 

Independent Claims _1_ - 3 = x $80 = $ 

Base Fee $710.00 

Declaration Late Filing Fee $130.00 

TOTAL FILING FEE $912.00 
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authorized to charge any fees under 37 C.F.R. §1.16 and §1.17 which may be required 
during the entire pendency of the application to said Account. 



I "EXPRESS MAIL" MAILING LABEL NUMBER: EL568148635US 
1 DATE OF DEPOSIT: November 1, 2000 

I HEREBY CERTIFY that the foregoing cover letter including the specification, claims, 
abstract, two (2) drawings, Preliminary Amendment and a stamped receipt post card are 
being deposited with the United States Postal Service "Express Mail Post Office to 
Addressee" service under 37 C.F.R. §1.10 on the date indicated and is addressed: ATTN: 
Patent Application, Commissioner of Patents and Trademarks, Washington, D.C. 
,20231. 
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PATENT APPLICATION 
IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 

In re application of 

Thomas FECHNER 

and Stefan HEINRICH 

Appln. No. : 

Filed: November 1, 2000 

For: PROCESS FOR RECOGNITION OF TRACK MARKERS 
USING IMAGE DATA 

Attorney Docket No.: 3926.017 

PRELIMINARY AMENDMENT 

Box: PATENT APPLICATION 

Honorable Commissioner of 

Patents and Trademarks 
Washington, D.C. 2 0231 

Sir: 

Prior to examination of the above -identified application, 
please amend the application as follows: 

IN THE TITLE : 

Please change the title to --PROCESS FOR RECOGNITION OF LANE 
MARKERS USING IMAGE DATA- - . 

IN THE SPECIFICATION : 

Page 1, delete the first full paragraph (lines 3-4) in its 
entirety; 

Page 1, line 5, insert: 

--BACKGROUND OF THE INVENTION 

Field of the Invention 

The invention concerns a process for recognition of vehicle 
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lane markings from image data, wherein the morphological 
characteristics of dot-shaped vehicle lane markings are evaluated 
on the basis of a priori knowledge. 

Description of the Related Art--; 

Page 2, delete the second and third paragraphs (lines 6-13) 
and insert : 

--It is the task of the invention to provide a new process 
for recognition of vehicle lane markings from image data. 

SUMMARY OF THE INVENTION 

In the inventive process the morphological characteristics 
of point-shaped vehicle land markers are evaluated on the basis 
of a priori knowledge. For this, those estimation processes are 
particularly useful, which are based on a Kalman Filter. After 
the selection of suitable ROI a Matched Filter is employed, in 
order to better extract from the background the image points 
associated with a vehicle lane marker. The inventive process is 
obviously not limited to point-shaped vehicle lane markers. 

BRIEF DESCRIPTION OF THE DRAWINGS- - ; 

Page 2, line 28, insert: 

--DETAILED DESCRIPTION OF THE INVENTION--. 

IN THE CLAIMS : 

Page 9, line 1, please delete "PATENT CLAIMS" and insert 
therefore --What is Claimed is:-- 
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1. (Amended) Process for recognition of vehicle lane markings 
from image data, [thereby characterized, that] wherein the 
morphological characteristics of dot -shaped vehicle lane 
markings are evaluated on the basis of a priori knowledge. 

2. (Amended) Process according to Claim 1, [thereby 
characterized, that] wherein from the totality of the image 
data, areas are extracted for processing, in which vehicle 
lane markings (ROI, regions of interest) are contained with 
high probability based upon a priori knowledge. 

3. (Amended) Process according to Claim 2, [thereby 
characterized, that] wherein the a priori knowledge is based 
upon the input of the camera geometry and/or the geometry of 
the vehicle track and/or the dimensions of the vehicle lane 
markings and/or the vehicle position. 

4. (Amended) Process according to Claim [s] 2 [-3] , [thereby 
characterized, that] wherein in the initialization of the 
process for recognition of vehicle lane markings model 
parameters are varied at random sequence so long until 
vehicle lane markings are found. 

5. (Amended) Process according to Claim 4, [thereby 
characterized, that] wherein the model parameter draws upon 
the width of the vehicle lane and/or the orientation of the 
camera with respect to the center of the vehicle lane and/or 
the yaw angle of the vehicle. 
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6. (Amended) Process according to Claim [s] 2 [-5], [thereby 
characterized, that] wherein for repositioning of the 
already initialized ROI parameter predictions, a vehicle 
street model based on a prediction of an evaluation process 
is drawn upon for parameter determination. 

7. (Amended) Process according to Claim 6, [thereby 
characterized, that] wherein the evaluation process for 
parameter determination is based upon a Kalman-f ilter . 

8. (Amended) Process according to [one of] Claim[s] 6 [-7], 
[thereby characterized, that] wherein in the repositioning 
of the ROI, its values are controlled by the variation of 
the result values of the prediction of the Kalman-f ilter, 
when the width is adapted proportionally to the size of the 
variation of the results. 

9. (Amended) Process according to [one of] Claim[s] 2 [-8] , 
[thereby characterized, that] wherein the ROI is limited 
vertically on the basis of a minimal and a maximal distance 
in the street plane. 

10. (Amended) Process according to Claim 9, [thereby 
characterized, that] wherein in particular in application of 
the process at night, the vertical limitation of the ROI is 
determined by the area of the maximal illumination (high 
beam, low beam) . 

11. (Amended) Process according to [one of] Claim[s] 9 [-10], 
[thereby characterized, that] wherein the limitation is 
controlled by the number of the image points expected to be 
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associated with the vehicle lane marker, and this control or 
regulation is optimal when the number of the image points to 
be expected is constant for all distance ranges. 

12. (Amended) Process according to [one of] Claim [s] 1[-11], 
[thereby characterized, that] wherein for processing of the 
areas (ROI) extracted from the image data, a matched- filter 
is employed in order to extract image points (pixels) , which 
are associated with vehicle lane markers . 

13. (Amended) Process according to Claim 12, [thereby 
characterized, that] wherein the matched-filter is adapted 
in shape and size to the vehicle lane marking being searched 
for and/or to the statistic of the background. 

14. (Amended) Process according to [one of] Claim [s] 12 [-13], 
[thereby characterized, that] wherein the matched-filter is 
implemented in separate form, in which the x-y-components 
are presented separately. 

15. (Amended) Process according to [one of] Claim [s] 12 [-14] , 
[thereby characterized, that] wherein in the framework of 
the use or application of the matched-filter, the average 
gray value of the background in the environment of the 
position to be examined is measured, and that upon the 
presentation of an image point, which is potentially to be 
associated with the vehicle lane marking, is closed or 
enclosed or concentrated on the basis of a comparison 
between background noise, the average gray value in the 
environment, and the gray value of the position to be 
examined . 
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16. (Amended) Process according to [one of] Claim [s] 12 [-15] , 
thereby characterized, that] wherein in the evaluation of 
the matched-filter, only the x-component is evaluated. 

17. (Amended) Process according to [one of] Claim [s] 12 [-16] , 
[thereby characterized, that] wherein after the extraction 
of the image points (pixel) , which are to be associated with 
vehicle lane markings, these are digitized, wherein the 
intensities of the individual pixels are compared with a 
threshold value, and the pixels are only then drawn upon for 
further evaluation when their intensity exceeds this 
threshold. 

18. (Amended) Process according to Claim 17, [thereby 
characterized, that] wherein the threshold value is 
determined from the background noise using a threshold value 
regulator or controller. 

19. (Amended) Process according to Claim 18, [thereby 
characterized, that] wherein the threshold value regulator 
draws upon a priori knowledge regarding the expected 
surfaces occupied by the vehicle lane markings, which are 
directly correlated with the expected number of image points 
(pixels) associated with the vehicle lane markings, and 
wherein the threshold value regulator or controller 
thereupon aims to supply the number of the image points 
extracted in the ROI preferably exactly to this expected 
value . 

20. (Amended) Process according to [one of] Claim [s] 1[-19], 
[thereby characterized, that] wherein after the extraction 
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of image points potentially belonging to a vehicle lane 
marker and the subsequent digitization, these image points 
are collected for the further processing into marker 
objects . 

21. (Amended) Process according to [one of] Claim [s] l[-20], 
[thereby characterized, that] wherein in the evaluation of 
the morphological characteristics of the vehicle lane 
marker, the size of the marking object (pixel group) and/or 
the roundness of the pixel group and/or the distribution of 
the pixels or, as the case may be, the number of empty 
spaces within the pixel group (compactness, clustering) is 
evaluated with respect to whether they satisfy the criteria 
of a vehicle lane marker defined in accordance with a priori 
knowledge . 

22. (Amended) Process according to Claim 21, [thereby 
characterized, that] wherein each pixel group, which 
satisfies the criteria of a vehicle lane marker, is 
considered to be an actual marker object and is 
characterized by its image coordinates. 

23. (Amended) Process according to Claim 22, [thereby 
characterized, that] wherein as characterizing image 
coordinates, the coordinates of the center of gravity of the 
pixel group associated with the marking object is selected. 

24. (Amended) Process according to [one of] Claim [s] 20 [-23], 
[thereby characterized, that] wherein the characteristic 
image coordinates of the marking object are employed in 
order with curve regression to describe the boundaries of 
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the own vehicle lane with respect to the course of the 
vehicle track, as well as to describe the own position with 
respect to the vehicle lane center, and that this 
description is provided to an estimation process for 
parameter determination (for example, a Kalman- filter) for 
repositioning of the ROI within the image data. 



The specification and claims have been amended to conform 
the original translated specification and claims to U.S. 
requirements, i.e., appropriate section headers are added, 
reference in the specification to the claims have been amended in 
order to eliminate multiple dependent claims and claims 
improperly depending from multiple dependent claims, and to 
otherwise conform the claims to U.S. practice. Care has been 
taken to ensure that no new matter is added to the text. 

Entry and favorable consideration prior to consideration are 
respectfully requested. 
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P.O. Box 20445 
Tampa, Florida 33622-0445 
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PROCESS FOR RECOGNITION OF TRACK MARKERS USING IMAGE DATA 



The invention concerns a process according to the pre- 
characterizing portion of Patent Claim 1. 

5 

Camera based systems for automatic vehicle tracking and for 
warning of unintentional deviations from the vehicle track or 
lane depend upon a reliable recognition of the vehicle lane 
boundaries. Typically, these boundaries are marked by means of 
10 continuous or interrupted lines. It is also known (for example: 
in the USA) to mark vehicle lane boundaries by a sequence of 
points (terrain points) . 

In us Patent 5,351,044, a process for recognition of vehicle lane 
J| boundaries is disclosed, which evaluates pixel -based image data. 
%J Therein, those image points of which the intensity or brightness 
^ significantly exceeds the intensity or brightness of the 
y surrounding or ambient points are assigned to a border. 

|0 Further, a process is known which evaluates the correlation of 
jh* the bordering image cells within the image data for detection of 
jZ the vehicle lane boundaries. For this it is however necessary to 
|^ transform the perspective camera data into non-perspective image 
y data . 
& 

US Patents 5,517,412 and 4,868,752 show processes for detection 
of the vehicle lane boundaries, which are based on the 
segmentation of linear elements by means of line detectors ("edge 
detection") with subsequent Hough- trans format ion for 
30 reconstruction of the boundary. Similar technology is disclosed 
in US Patent 4,970,653, wherein here the segmentation of the line 
elements is supported by supplemental template matching. 
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In the process proposed in US Patent 6,091,833, the area in which 
linear detection is carried out is curtailed by the selection of 
areas which, transformed in the frequency space, exhibit a high 
intensity by their low frequency components. 

5 

The task of the invention is to provide a new type of process 
according to the pre -characterizing portion of Patent Claim 1. 

The task is solved by a process, which is described by the 
10 characteristic features of Patent Claim 1. Advantageous 
embodiments and further developments of the invention are set 
forth in the dependent claims and described on the basis of 
illustrative embodiments and figures. 

925 Figure 1 shows an image section 10 with point -shaped vehicle lane 
Q markings 11 and selected areas (ROI) 12, 

W Figure 2 shows a flow diagram with respect to the recognition of 
the point-shaped vehicle lane markings 11. 

£0 

y : Figure 3 shows a flow diagram concerning the binarization or 
O digitization of the image point (pixel) which is associated with 
]Z the vehicle lane boundary 11. 

25 Figure 4 shows an example of a gray- scale or tonal value 
processing of image data, wherein the regions evaluated by the 
matched- filter are extracted. 

In the inventive process, the morphological characteristics of 
30 point-shaped vehicle lane markings are considered or evaluated on 
the basis of a priori or common knowledge. Therein, beginning 

with a starting image, a multi-step search is made for point- 
shaped vehicle lane markings ("Bot Dot Markings") . 
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In Figure 1 there is shown a preferred manner, in which for 
minimizing the processing complexity, and, at the same time, for 
reduction the false alarm likelihood, areas (ROI) 12 to be 
processed are separated out from the totality of the image data 
10. This occurs beginning with a priori knowledge with the goal, 
to select areas 12, which with high probability contain vehicle 
lane markings, so called ROI (regions of interest) . Herein the 
positioning of the ROI occurs in effective manner on the basis of 
the known camera geometry (height, tilt angle,. . . ) as well as 
on the basis of other perimeters such as for example the geometry 
of the vehicle track, the dimensions of the vehicle lane markings 
or the vehicle position within the vehicle lane. Herein it is 
generally assumed, that the vehicle is situated between left and ' 
right markings, and the vehicle lane breadth meets certain 
standards . 

In Figure 2 there is shown, as an example, the individual steps 
of the inventive image data processing beginning from camera 
image 10, which still contains the entire image information, up 
to the extraction of the coordinates for individual elements of 
the vehicle lane marking, which in general correspond to the 
coordinates of marking points. 

In a first step 21 areas (ROI) 12 are separated out from the 
entirety of the image data 10 to be processed. For this, in the 
initialization of the ROI 12 in the framework of the inventive 
process model parameters are varied so long until vehicle lane 
markings are found. Therein, as model parameters there are taken 
into consideration for example information such as the breadth of 
the vehicle lane, the positioning or orientation of the camera 
with respect to the center of the vehicle lane or the yaw angle 
of the vehicle. In the later course of the process, for 



repositioning of already initialized ROI 12, parameter 
predictions from a vehicle -street -model are drawn upon on the 
principle of a prediction of an evaluation process for parameter 
determination. For this, evaluation processes are advantageous 
which are based upon a Kalman-f ilter . In the repositioning of 
the ROI 12, it is in advantageous manner controlled by the 
variation of the result value of the prediction of the evaluation 
process for parameter determination, wherein the width is adapted 
proportionally to the size of the variance of the results. It is 
likewise advantageous to limit the ROI 12 vertically on the basis 
of a minimal and a maximal distance in the street plane. This is 
particularly useful when the inventive process is employed at 
night. Herein in advantageous manner the vertical limitation of 
the ROI 12 is determined by the range of the maximal illumination 
(high beam, low beam) . It is conceivable that the regulation is 
controlled by the number of the image points expected to be 
associated with a vehicle lane marking, wherein this regulation 
is then considered as optimal when the number of the image or 
measuring points to be expected is maintained constant over all 
di s t anc e range s . 

According to the number of suitable ROI 12, a matched- filter is 
employed in process step 22, in order to better extract the image 
points (pixels) associated with a vehicle lane marking from the 
background. Herein the matched- filter is advantageously adapted 
to the shape and size of the vehicle lane marking and/or the 
statistics of the background being searched. 

In particularly advantageous manner, the matched filter is so 
arranged that in the framework of its application in the 
environment of the position being examined, the average gray 
scale or tone value (hereafter gray value) of the background is 
measured, and that on the presentation of an image point, which 



is potentially to be associated with a vehicle lane marking, is 
confined on the basis of a comparison between background noise, 
the average gray value in the environment, and the gray value of 
the position to be searched. In general, for this the filter is 
5 implemented in separated geometry or model- type, in which the x-y 
components are presented separately. It has however been found, 
that for location or determination of point -shaped vehicle lane 
markings in the most cases, the processing complexity can be 
reduced, when in the evaluation of the matched filter only the x- 

10 components are considered. For this, the average value and the 
standard deviation right and left of a position to be examined 
are measured. If the gray value exceeds the average value of the 
intensity of the background at more than the comparative 
threshold determined from the white noise of the background and 

jj threshold determination, the position is marked as potentially 

%J belonging to a vehicle lane marking. 

hj Figure 4 shows, as an example, the gray value curve 40 over an 
% image cell to be evaluated within the image data or, as the case 
20 may be, the ROI, wherein in this example only the x components 
are taken into consideration. For evaluation of the image point 
Q 41 on the position x 0 of the image cell, the intensity thereof as 
~ well as the statistical information of two same size areas SI and 
0 S2 ' which are situated at a distance d of xO therefrom, are 
25 evaluated. The distance d is preferably selected to be a value, 
which is predicated or predicted by the evaluation process for 
parameter determination in process step 21 (Fig. 2) as the to be 
expected width of an element of the vehicle lane marking. It is, 
on the other hand, however also possible to assign the distance d 
30 in the framework of the inventive process a fixed value (for 
example an expected value) and to so leave it. The size of the 
area or range or field SI and S2 is in advantageous manner 
selected to be identical, wherein their measurements, if 
possible, should not be larger than the predicated or predicted 
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value of an element of the vehicle lane marking. If this 
predicted value is however so small that no useful statistical 
evaluation of the values contained in SI or, as the case may be, 
S2 any longer appears possible, then the areas or ranges SI or, 
5 as the case may be, S2 can also be selected to be larger. In 
practice, in the predication of the width of the elements of the 
vehicle lane markings of two pixels, the selection of five pixels 
as the width of areas SI and S2 has been found to be effective. 

10 From the values within areas or ranges SI or S2, the average 
values Al or, as the case may be, A2 and the standard deviation 
Gl or, as the case may be, o2 is calculated. The standard 
deviation al or, as the case may be, g2 is subsequently employed 
f „ for calculation of the threshold values Tl or, as the case may 
If be, T2. Therein, it is conceivable, in a first step or statement 
or set-up to select the threshold values according to the three - 
lj fold of the respective standard deviations, thus to select Tl = 3 
lw * al and T2 = 3 * a2 . In particularly advantageous manner, the 
m thus generated threshold values are corrected by means of a 
20 threshold value controller or regulator 25 described in greater 
M: detail in the following. After the determination of the 
^ threshold values Tl or, as the case may be, T2 and their 
O subsequent correction, the support points for the comparison 
P threshold 42 is calculated by addition of Tl and Al or, as the 
25 case may be, T2 and A2 . Herein the center of the area SI and S2 
is advantageously selected as the x-position of the support 
point. Subsequently, the value 41 at the position x 0 can now be 
compared with the value of the comparison threshold 42 and the 
comparison result can in inventive manner be drawn upon for 
30 identification of elements of the vehicle lane marking. 

The image point (pixel) identified and extracted by the matched- 
filter, which is associated with vehicle lane markings, are 
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digitized (conversion to binary) in processing steps 23, 24, and 
25 and collected into groups. In the digitization, the intensity 
of the individual pixels are compared with a threshold value and 
then the compared pixels are only drawn upon for a further 
5 processing when their intensity exceeds this threshold value. In 
Figure 3, the inventive process step for digitization is 
elucidated on the basis of a flow diagram. Herein the threshold 
value Tl and T2 is determined from the background noise in 
advantageous manner by means of a threshold value controller 25. 

10 For the determination thereof, it is useful when the threshold 
value controller draws upon a priori knowledge about the expected 
surface 35 occupied by the vehicle lane marking, which correlates 
directly with the expected number of the vehicle lane marking 

y associated image points (pixels) . In this manner, the threshold 

|f value controller 25 can be so set up or arranged, that it aims in 

""'ii 

0 directed manner to relate the number in the ROI 12 extracted 

y image points as precisely as possible to the expected value 

P] thereof. After the extraction of image points potentially 

J" belonging to a vehicle lane marking and their subsequent 

26 digitization 33, these are collected in process step 24 for a 

g further processing (for example within 35) for marking objects 

^ (pixel groups) . 

After the generation of marking objects, these can be examined in 
25 process step 27 with respect to their correspondence with the 

known morphological characteristics of the vehicle lane markings. 
Herein in advantageous manner for example the size of the marking 
objects, their roundness, the individual image points (pixels) , 
or the number of free spaces within the marking objects 
30 (compactness, clustering) are evaluated, as to whether they can 
satisfy the criteria of the morphological characteristics of the 
vehicle lane markings on the basis of a priori knowledge. Based 
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upon this determination, each pixel group, which satisfies the 
criteria of a vehicle lane marking, is considered to be an actual 
marking object and is characterized by the image coordinates. 
For this, in advantageous manner, the coordinates of the center 
5 of gravity of the marking image associated pixel group can be 
selected as the characterizing image coordinates. 

After successful characterization of the marking object, the 
image coordinates can be employed, using curve regression, in 

10 order to describe the boundaries of the own vehicle track or in 
certain cases, the course of the vehicle track as well as the own 
position with respect to the the vehicle lane center. It is then 
particularly useful to supply this description to the inventive 
evaluation process for parameter determination (for example a 

© Kalman- filter) for repositioning of the ROI within the image 

r* t data . 

fz The invention process is, of course, not limited to the 
p recognition of dot-shaped vehicle lane markers. It is also 
2® possible therewith, for example, to recognize continuous linear 
U vehicle lane markings even when these have been strongly degraded 
M by changes or wear. 
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Patent Claims 



Process for recognition of vehicle lane markings from image 
data, thereby characterized, that the morphological 
characteristics of dot -shaped vehicle lane markings are 
evaluated on the basis of a priori knowledge. 



Process according to Claim 1, thereby characterized, that 
from the totality of the image data, areas are extracted for 
processing, in which vehicle lane markings (ROI, regions of 
interest) are contained with high probability based upon a 
priori knowledge. 



3. Process according to Claim 2, 
the a priori knowledge is based 
geometry and/or the geometry of 
dimensions of the vehicle lane 
position. 



thereby characterized, that 
upon the input of the camera 
the vehicle track and/or the 
markings and/or the vehicle 



4. Process according to Claims 2-3, thereby characterized, that 
in the initialization of the process for recognition of 
vehicle lane markings model parameters are varied at random 
sequence so long until vehicle lane markings are found. 

5. Process according to Claim 4, thereby characterized, that 
the model parameter draws upon the width of the vehicle lane 
and/or the orientation of the camera with respect to the 
center of the vehicle lane and/or the yaw angle of the 
vehicle . 



6. Process according to Claims 2-5, thereby characterized, that 
for repositioning of the already initialized ROI parameter 
predictions, a vehicle street model based on a prediction of 
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an evaluation process is drawn upon for parameter 
determination . 

Process according to Claim 6, thereby characterized, that 
the evaluation process for parameter determination is based 
upon a Kalman- filter . 

Process according to one of Claims 6-7, thereby 
characterized, that in the repositioning of the ROI, its 
values are controlled by the variation of the result values 
of the prediction of the Kalman- filter, when the width is 
adapted proportionally to the size of the variation of the 
results , 

Process according to one of Claims 2-8, thereby 
characterized, that the ROI is limited vertically on the 
basis of a minimal and a maximal distance in the street 
plane . 

Process according to Claim 9, thereby characterized, that in 
particular in application of the process at night, the 
vertical limitation of the ROI is determined by the area of 
the maximal illumination (high beam, low beam) . 

Process according to one of Claims 9-10, thereby 
characterized, that the limitation is controlled by the 
number of the image points expected to be associated with 
the vehicle lane marker, and this control or regulation is 
optimal when the number of the image points to be expected 
is constant for all distance ranges. 

Process according to one of Claims 1-11, thereby 
characterized, that for processing of the areas (ROI) 
extracted from the image data, a matched- filter is employed 



in order to extract image points (pixels) , which are 
associated with vehicle lane markers. 

Process according to Claim 12, thereby characterized, that 
the matched- filter is adapted in shape and size to the 
vehicle lane marking being searched for and/or to the 
statistic of the background. 

Process according to one of Claims 12-13, thereby 
characterized, that the matched- filter is implemented in 
separate form, in which the x-y- components are presented 
separately. 

Process according to one of Claims 12-14, thereby 
characterized, that in the framework of the use or 
application of the matched- filter, the average gray value of 
the background in the environment of the position to be 
examined is measured, and that upon the presentation of an 
image point, which is potentially to be associated with the 
vehicle lane marking, is closed or enclosed or concentrated 
on the basis of a comparison between background noise, the 
average gray value in the environment, and the gray value of 
the position to be examined. 

Process according to one of Claims 12-15, thereby 
characterized, that in the evaluation of the matched-filter, 
only the x-component is evaluated. 

Process according to one of Claims 12-16, thereby 
characterized, that after the extraction of the image points 
(pixel) , which are to be associated with vehicle lane 
markings, these are digitized, wherein the intensities of 
the individual pixels are compared with a threshold value, 
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and the pixels are only then drawn upon for further 
evaluation when their intensity exceeds this threshold. 

Process according to Claim 17, thereby characterized, that 
the threshold value is determined from the background noise 
using a threshold value regulator or controller. 

Process according to Claim 18, thereby characterized, that 
the threshold value regulator draws upon a priori knowledge 
regarding the expected surfaces occupied by the vehicle lane 
markings, which are directly correlated with the expected 
number of image points (pixels) associated with the vehicle 
lane markings, and wherein the threshold value regulator or 
controller thereupon aims to supply the number of the image 
points extracted in the ROI preferably exactly to this 
expected value. 

Process according to one of Claims 1-19, thereby 
characterized, that after the extraction of image points 
potentially belonging to a vehicle lane marker and the 
subsequent digitization, these image points are collected 
for the further processing into marker objects. 

Process according to one of Claims 1-20, thereby 
characterized, that in the evaluation of the morphological 
characteristics of the vehicle lane marker, the size of the 
marking object (pixel group) and/or the roundness of the 
pixel group and/or the distribution of the pixels or, as the 
case may be, the number of empty spaces within the pixel 
group (compactness, clustering) is evaluated with respect to 
whether they satisfy the criteria of a vehicle lane marker 
defined in accordance with a priori knowledge. 
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22. Process according to Claim 21, thereby characterized, that 
each pixel group, which satisfies the criteria of a vehicle 
lane marker, is considered to be an actual marker object and 
is characterized by its image coordinates . 

23. Process according to Claim 22, thereby characterized, that 
as characterizing image coordinates, the coordinates of the 
center of gravity of the pixel group associated with the 
marking object is selected. 

24. Process according to one of Claims 20-23, thereby 
characterized, that the characteristic image coordinates of 
the marking object are employed in order with curve 
regression to describe the boundaries of the own vehicle 
lane with respect to the course of the vehicle track, as 
well as to describe the own position with respect to the 
vehicle lane center, and that this description is provided 
to an estimation process for parameter determination (for 
example, a Kalman-f ilter) for repositioning of the ROI 
within the image data. 
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ABSTRACT OF THE DISCLOSURE 



PROCESS FOR RECOGNITION OF TRACK MARKERS USING IMAGE DATA 



In the inventive process the morphological characteristics of 
point-shaped vehicle lan<4> markers are evaluated on the basis of a 
priori knowledge. For this, those estimation processes are 
particularly useful, which are based on a Kalman Filter. After 
the selection of suitable ROI a Matched Filter is employed, in 
order to better extract from the background the image points 
associated with a vehicle lane marker. The inventive process is 
obviously not limited to point-shaped vehicle lane markers. 
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Fig^ 3 
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